ORC  68-20 
JULY  1968 


AN  APPLICATION  OF  THE  BRANCH - 


AND-BOUND  METHOD  TO  THE 


CATALOGUE  ORDERING  PROBLEM 

\ 


OPERATIONS 

RESEARCH 

CENTER 


UNIVERSITY  OF  CALIFORNIA 


'  1 


BERKELEY 


* 


AN  APPLICATION  OF  THE  BRANCH-AND-BOUND  METHOD 
TO  THE  CATALOGUE  ORDERING  PROBLEM 

by 

Leonard  J.  Jacobson 
Operations  Research  Center 
University  of  California,  Berkeley 


July  1968  ORC  68—20 

This  research  has  been  supported  by  the  Office  of  Naval  Research  under 
Contract  Nonr-3656(18)  with  the  University  of  California.  Reproduction 
in  whole  or  in  part  is  permitted  for  any  purpose  of  the  United  States 
Government. 


r 

k 


ACKNOWLEDGEMENT 


I  would  like  to  thank  Dr.  Lawrence  Bodin  of  the 
IBM  Washington  Scientific  Center  for  suggesting 
this  problem  and  for  spending  much  of  his  time 
discussing  it  with  me. 


AN  APPLICATION  OF  THE  BRANCH- AND- BOUND  METHOD 
TO  THE  CATALOGUE  ORDERING  PROBLEM 


Leonard  J.  Jacobson 


1.  INTRODUCTION 

A  parallel  (or  series)  system  of  components  is  considered.  Each  component 
of  the  system  is  assumed  to  be  chosen  from  a  set  of  available  components  each 
with  a  specified  reliability  and  a  specified  cost.  The  problem,  that  of  minimizing 
the  cost  of  the  system  while  guaranteeing  a  specified  system  reliability,  can  be 
written  as  a  zero-one  integer  program.  A  branch-and-bound  algorithm  is  the 
suggested  solution  method. 

2.  STATEMENT  OF  THE  PROBLEM 

+ 

Consider  a  parallel  coherent  system  in  n  components.  Let  the  i-th 
component,  c^  ,  come  from  a  set,  ,  of  possible  components.  That  is, 

c  Sj,i  «  1,2,  . ...  n  .  Assume  m  6  ,  for  i  ^  j  .  Let  k^  *  number 

of  elements  in  .  Associated  with  each  element  s^  of  is  a  reliability 

p^  and  a  cost  c^  . 

We  would  like  to  choose  c^  from  ,  c ^  from  S2  >  etc.,  in  such  a  way 
as  to  minimize  the  cost  of  constructing  the  system  while  guaranteeing  a  system 
reliability  of  at  least  a  . 

We  will  assume  that  in  each  set  ,  there  is  no  pair  of  elements  s^ 

and  s..  such  that  p..  >  p.,  and  c..  <  c.,  ,  because  if  there  were,  we 

ik  *ij  *ik  ij  -  ik 

would  never  consider  element  s^  •  Therefore,  p^  >  p^  <■=>  >  c^  . 


The  analysis  is  the  same  if  the  system  is  in  series. 
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1  if  e  Sj,  is  chosen  for  the 


Let  x 


ij 


0  otherwise. 


i-th  component  of  the  system 


The  system  reliability  can  be  written 

k. 

n  i  x 

R  -  1  -  n  n  (1  -  p  )  13  . 
i-1  j-1  13 

k 

n  i 

The  constraint  R  >  a  is  equivalent  to  £  £  a,  x  <  K  where 

i-1  j-1  13  13 

a^  -  ln(l  -  p  )  and  K  -  ln(l  -  a)  .* 

3.  THE  MATHEMATICAL  PROBLEM 

The  problem  can  be  atated  mathematically  as  follows: 


(1) 


Minimize 


n  ki 

I  l 

i-1  j-1 


c 


ijXij 


Subject  to 


i  i  aijxii  i  k 

i-i  j-i  13  13 


i 

y 

j-i 


- 1 


0  or  1 


(I) 


i  -  1,2,  . . . ,  n 
for  all  i,j 


Problem  (I)  is  a  linear  Integer  programming  problem.  The  method  used  to 
solve  this  problem  starts  by  solving  a  linear  program  which  is  identical  to 
Problem  (I)  with  the  exception  that  the  constraint  -  0  or  1  for  all 

i,j  is  replaced  by  x^  >  0  for  all  i,j  Call  the  LP  problem  Problem  (II). 


t 

a 


lote  that  for  the  system  in  series, 
j  -  -In  p^j  and  K  -  -In  a  . 


the  form  of  the  constraint  is  the  same  with 
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Problem  (II)  has  £  k  variables  and  n  +  1  constraints.  A  simple  check 
i=l  1 

for  the  feasibility  of  Problem  (II)  is  as  follows:  Let  j  =  second  index  of 


min  •  •  •  >  ® ^  J i ^  e  1 ^ »  •  •  • »  t  .  Let  c  ^2j 


nj. 


and  all  other  x^  =  0  .  Th<_n  if  this  solution  is  not  feasible,  no  integer 

solution  will  be  feasible  and  we  will  terminate.  If  this  solution  is  feasible, 

there  will  be  an  LP  solution.  Since  the  variables  of  Problem  (II)  are  all  bounded 

between  zero  and  one,  we  know  it  has  an  optimal  solution  and  the  optimal  functional 

value  z  is  a  lower  bound  to  the  solution  of  Problem  (I). 
o 

Let  us  say  we  use  the  simplex  method  on  Problem  (II)  and  arrive  at  an 

* 

optimal  solution  X  . 

Since  Problem  (II)  has  n  +  1  constraints,  at  optimality  at  most  n  +  1 

* 

components  of  will  be  positive  and  all  others  are  zero. 

Let  us  call  x^.x^,  •••.  *lk  the  i-th  group  of  variables,  i  -  1,2 . 

Theorem  1: 


At  optimality  of  Problem  (II),  one  of  the  following  two  conditions 
obtains : 


(1)  In  n  -  1  of  the  n  groups  of  variables,  exactly  one  variable  equals 

one  and  all  others  are  zero.  In  the  n-th  group,  two  of  the  variables 

are  positive  and  their  sum  is  one. 

(2)  In  all  n  groups  of  variables,  exactly  one  variable  equals  one  and  all 

others  are  zero.  The  slack  variable  in  the  Inequality  constraint  will 

either  be  positive  or  it  will  be  zero  but  basic. 

Proof : 

Suppose  in  each  of  two  groups,  there  were  two  positive  variables.  Since 


there  are  at  most  n  +  1  positive  variables,  there  would  be  at  most 
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n+l-4=n-3  positive  variables  remaining.  But  there  would  be  remaining 
n  -  2  constraints  of  the  form 


i 

l 

J=1 


1 


(2) 


Since  this  constraint  would  be  impossible  to  meet  in  n  -  2  groups  with  only 
n-3  positive  variables,  we  must  conclude  that  at  most  one  group  will  have  two 
positive  variables.  A  similar  argument  shows  that  no  single  group  could  have 
three  positive  variables.  This  being  the  case,  n  -  1  groups  have  one  positive 
variable  each.  Since  each  of  these  groups  has  the  constraint  (2),  that  one  positive 
variable  in  each  of  these  n  -  1  groups  must  equal  one.  The  n-th  group  then 
has  either  one  or  two  positive  variables  (it  cannot  have  no  positive  variables 
because  it,  too,  must  satisfy  (2)).  If  it  has  two  positive  variables,  (2) 
tells  us  their  sum  is  one.  If  it  has  one  positive  variable,  (2)  says  it  must 
equal  one,  and  the  (n  +  l)st  variable  can  only  be  the  slack  in  the  inequality. 

The  slack  variable  must  then  be  basic  in  the  optimal  solution,  though  it  could 
still  have  zero  value.  // 

If  condition  (2)  above  obtains,  we  have  an  integer  solution  and  we  are 
finished.  Let  us  assume  that  condition  (1)  obtains.  That  is,  we  have  solved 
Problem  (II)  and  have  obtained  a  solution  in  which  one  group  has  two  positive 
variables  and  all  others  have  one  positive  variable.  For  convenience,  let  us 
reorder  the  variables  so  that  the  first  one  in  each  group  is  positive.  In  the 
group  with  two  positive  variables,  the  variables  are  reordered  so  that  it  is  the 
first  two  variables  which  are  positive.  Finally,  the  rows  are  reordered  so  that 
it  is  the  first  group  that  contains  two  positive  variables.  Figure  1  shows  the 
tableau  at  optimality  of  Problem  (II). 


6 


where  the  variable  "w"  is  the  slack  variable.  Those  variables  in  boxes  are  the 
basic  canonical  variables  which  form  the  LP  solution.  It  can  be  shown  that 


Cll> 


aH  "  ail  ) 

a12  '  all  ) 


(3) 


C12  "  C11  1  -1  1 
-  .  j  .  -  .  f  ■  -  «  -d 

a12  ‘  all  a12  '  all  a12  ‘  all 


(A) 


a12  "  all  ’  « 


ail  ~  8i1  ± 
a12  "  all 


2  3 


n 


(5-a) 


b 


3J 


(5-b) 


i  -  2,3, 


n 


K-  I 


r  -  — — —  ;  *_  -  l  c  .  +  (c  ,  -  c  )t  . 

a12  all  °  i-1  11  12  11 


il 


(5-c) 


(6) 


Since  the  solution  is  optimal,  we  know  that  0  <  t  <  1  ,  c  >  0  ,  i-  1,2,  ...,  n 
J  -  1,2,  ....  ,  and  i  >  0  . 

Now  we  introduce  the  method  of  "Branch--and-Bound"+  to  the  problem.  As  the 
tableau  in  Figure  1  indicates,  x^  -  1  -  t  ,  x^2  -  t  ,  and  x^  »  1  for 
i  -  2,3,  ...,  n  .  All  other  variables  are  zero.  We  will  partition  the  node  at 
the  origin  into  three  nodes  as  indicated  in  Figure  2. 


+See  [1J. 


r 


1 


■!  i 


'll 


FIGURE  2:  BRANCHING  FROM  THE  ORIGIN 


where  zq  in  the  origin  node  indicates  the  lower  bound  to  all  integer  solutions. 

We  now  solve  Problem  (II)  with  the  added  constraint  *  1  .  This  problem 

n 

is  an  LP  problem  in  £  k  variables  and  n  constraints.  The  initial  tableau 

i-2 

can  be  written  by  inspecting  the  tableau  of  Figure  1.  It  is  given  in  Figure  3. 


cost  row 

C22x22+,**+C2k2X2k 

1-st  row 

^22X22+,,,+^2k2X2k 

2-nd  row 

• 

• 

X21 

+  x22+...+  x2k 

• 

• 

n-th  row 

"n2  n2 


n2  n2 


’tik  nk 
n  n 


nk  nk 
n  n 


jlU 


+  x  «+. . .+  x  . 
n2  nk 


-  1 


FIGURE  3:  INITIAL  TABLEAU  FOR  PROBLEM  (II)  WITH 
ADDED  CONSTRAINT  xn  -  1 

This  tableau  is  not  in  canonical  form  because  there  are  only  n  -  1  basic 
variables;  namely,  x^  ■  x^  ■  ...  ■  x^  ■  1  . 

Before  we  proceed  any  further,  however,  we  check  (in  the  same  manner  as 
before)  to  see  if  our  problem  is  feasible  with  the  added  constraint  x^  -  1  . 

If  it  is  not  feasible,  we  prune  this  branch.  We  proceed  assuming  it  to  be  feasible. 
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The  n-th  basic  variable  is  obtained  by  pivoting  on  one  of  the  coefficients 
in  the  first  row  of  the  set  of  n  constraints.  We  will  pick  this  element  so  as 
to  maintain  the  nonnegativity  of  the  cost  coefficients.  If  there  is  no  positive 
b^j  ,  f  must  be  positive.  We  pivot  on  f  making  the  slack  variable,  v  , 
basic.  If  there  is  at  least  one  positive  b^  ,  then  we  find  the  indices  "rs" 
which  satisfy 


c 

f  c . 

rs 

-  *=  min 

1  _il 

b 

1  b. . 

rs 

1  ij 

bij  » 0 


(7) 


If  f  >  0  and 


c 

£  < 
f  ”  b 

rs 


,  it  is  again  the  case  that  the  slack  variable1  w  , 


should  be  added  to  the  basis.  In  this  case,  the  solution  to  the  LP  problem  in 
Figure  3  is  integer.  We  will  not  partition  any  further  from  this  node;  and  in 
Figure  2,  the  question  mark  at  the  end  of  the  arc  marked  "x^  “  1"  is  replaced 
by  the  optimal  functional  value  of  this  LP  problem.  This  would  be  our  first 
integer  feasible  solution  to  Problem  (I).  From  this  point  on,  we  would  accept 
integer  solutions  only  if  the  corresponding  functional  value  Is  less  than  that  of  the 

current  integer  solution.  We  will  denote  the  best  feasible  integer  solution  by 

*  * 

Y  and  the  functional  value  by  y  . 

c 

—  —  jz  r  s 

If,  on  the  other  hand,  f  <  0  or  f  >  0  but  A  >  -  ,  then  we  pivot  on 

f  b 


rs 


element  b 


rs 


In  this  case,  we  find  that  the  basic  canonical  solution  is 


*21  '  X31  '  •••  '  Vl,l  "  1  ;  *rl  *  1  -  ‘  t~  ’  * 

D  D 

rs  rs 

...  ■  x  ,  ■  1  ,  and  all  other  x..  *  0  . 
nl  ij 


r+1 ,1 


The 


question  now  is,  "Is  x  <  1  ?"  If  it  is,  we  immediately  have  the 
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solution  to  this  constrained  LP  problem.  If  it  is  not,  then  we  are  dual  feasible 
but  not  primal  feasible. 

We  now  apply  the  dual  simplex  method  to  solve  this  problem.  Since  we  start 
with  only  one  negative  element  on  the  RHS,  we  can  expect  that  the  solution,  on 
the  average,  should  come  quickly.  When  the  solution  is  obtained,  the  functional 
value  is  put  in  place  of  the  question  mark  in  Figure  2. 

If  the  LP  solution  is  integer,  then,  we  need  not  partition  that  node  further; 

* 

and  we  say  that  we  have  a  feasible  integer  solution  Y  and  its  corresponding 

* 

functional  value  y 

If  the  LP  solution  is  noninteger,  then  when  we  partition  further  from  this 
node,  we  will  partition  on  the  two  noninteger  variables  as  we  did  after  the 
original  LP  problem  (as  shown  in  Figure  2) . 

To  solve  the  problem  at  the  node  along  the  arc  marked  "x^  *  >  we  must 

first  reconstruct  the  optimal  tableau  of  Figure  1.  This  is  facilitated  by 
storing  in  memory  the  indices  of  the  basic  variables  in  the  optimal  solution  to 
the  first  LP  problem.  From  this  point  on,  the  problem  is  handled  identically  to 
the  way  it  was  handled  along  the  arc  marked  "x^  ■  1"  •  We  will  call  the  optimal 
value  of  the  functional  of  this  problem,  (assuming  it  exists). 

Along  the  arc  marked  "x^  "  x^2  *  we  have  a  slight  change.  First  we 
check  to  see  if  the  problem  is  feasible  in  the  same  manner  as  mentioned  earlier. 
Assuming  it  is,  we  reconstruct  the  taoleau  of  Figure  1  and  remove  the  variables 
x^  and  x^  (they  are  zero  at  any  successor  node  to  this  node).  Now  the  tableau 
is  not  in  canonical  form.  To  put  it  in  canonical  form,  we  will  pivot,  on  two 
elements,  one  at  a  time.  With  each  pivot,  we  will  remain  dual  feasible.  In  the 
first  row  of  the  constraints,  if  none  of  the  a^  is  positive,  then  d  >  0  must 
hold.  We  pivot  on  d  .  If,  however,  at  least  one  of  the  a^ 


is  positive,  we 
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find  the  indices  "rs"  which  satisfy 


c 

rs 

a 

rs 


(8) 


Having  computed  (8),  if  d  <  0  ,  we  pivot  on  a  .  If,  on  the  other  hand, 

IT  S 

C 

—  —  rs  K 

d  >  0  ,  we  pivot  on  a  if  -  <  ■“  .  If  the  inequality  goes  the  other  way 

r  s  —  "7 

a  d 
rs 

we  pivot  on  d  . 

Since  we  are  assuming  the  problem  is  feasible,  we  must  have  at  least  one 
of  the  variables  positive  in  the  first  group.  Thus,  if  the  pivot  element  that 
we  just  found  is  in  any  group  other  than  the  first,  on  the  second  pivot  we  must 
choose  an  element  from  the  first  group  and  must  maintain  the  nonnegativity  of 
the  cost  coefficients  with  that  pivot.  We  will  see  shortly  that  this  is  always 
possible. 

If  this  first  pivot  element  is  not  from  the  first  group,  then  after 
pivoting  on  it,  the  new  tableau  will  appear  schematically  (i.e.,  the  line  indicates 
the  existence  of  nonzero  elements)  as  in  Figure  4. 


cost  row 
1-st  row 


2- nd  row  x^+* . 

3- rd  row 

r+1  row  - 

# 

n+1  row 


•  • 


-z 


•  • 


_  i-t 
a 

rs 

*  1 


-  1 

-  1  - 


=  1 


1-t 

a 

rs 


FIGURE  4:  SCHEMATIC  REPRESENTATION  AFTER  PIVOTING  IN  FIRST  ROW 
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Notice  that  by  pivoting  on  a  ,  the  entire  second  row  vanishes,  except  for  the 
elements  of  the  first  group  in  which  the  new  coefficients  are  all  one.  That  this 
is  true  follows  from  Equations  (5— b )  and  (5-e). 

The  second  pivot  will  be  on  an  element  in  the  second  row.  Since  all 
coefficients  not  in  the  first  group  have  vanished,  the  pivot  can  only  be  on  an 
element  in  the  first  group. 

So  as  to  maintain  the  nonnegativity  of  the  cost  coefficients,  the  second 
pivot  element  v?ill  be  chosen  by  finding  the  index  "q"  such  that 

'lq  ’  mln  I'lj!  •  (9) 


Note  that  a  double  bar  has  been  used  to  indicate  that,  because  of  our  first 
pivot  on  a  ,  these  coefficients  are  no  longer  those  in  Figure  1.  The  schematic 
representation  of  the  canonical  tableau  is  shown  in  Figure  5. 


cost  row 


1-st  row  - 


2'nd  row - 

3-rd  row 

r+1  row  - 

n+1  row 


•  •  • 


-•  •  • 


•  •  • 


rd 


-•  •  • 


•  •  • 


«  *  * 


nil 


1-t-a 


la 


rs 


1 

1 

1  - 


1-t-a 


la 


rs 


FIGURE  5:  SCHEMATIC  REPRESENTATION  AFTER  THE  SECOND  PIVOT 

I 

j 

Since  we  chose  the  two  pivot  elements  so  as  to  maintain  the  nonnegativity 
of  the  cost  coefficients,  we  know  we  are  dual  feasible.  We  will  be  primal 


feasible  if  and  only  if 
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0  < 


a 

rs 


(10) 


If  (10)  holds,  then  we  are  at  optimality.  If  not,  we  apply  the  dual  simplex 
method  which  will  yield  the  optimum  solution  and  functional  value.  If  at 
optimality  the  slack  variable,  w  ,  is  basic,  we  have  an  integer  solution  and 
we  need  not  partition  this  node  any  further.  The  optimal  functional  value  is 
compared  with  any  previous  integer  solution  functional  value  to  see  if  we  will 
keep  the  current  solution  or  discard  it  because  we  already  have  a  better  one. 

If  at  optimality,  we  have  a  noninteger  solution,  the  functional  value,  , 

replaces  the  question  mark  in  Figure  2  and  when  we  partition  this  node  further, 
the  partitioning  will  be  on  the  two  noninteger  variables  as  we  did  after  the 
original  LP  problem. 

At  this  point,  we  have  concluded  the  first  step  of  the  problem.  Figures  6 
and  7  show  two  possible  trees  at  the  end  of  the  first  step. 


FIGURE  6:  A  POSSIBLE  TREE  AFTER  THE  FIRST  STEP 


FIGURE  7:  ANOTHER  POSSIBLE  TREE  AFTER  THE  FIRST  STEP 
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* 

where  y  indicates  an  integer  solution  was  found  when  we  constrained  ■  1  , 

and  the  crossed-out  node  indicates  that  no  feasible  solution  could  be  found  when 
we  constrained  x^  *  "  0  . 

The  second  step  of  the  problem  begins  by  first  choosing  from  all  feasible 
pendant  nodes,  the  minimum  of  the  (we  say  "feasible"  because,  as  in  Figure  7, 

some  nodes  may  not  need  to  be  partitioned  further),  and  we  will  carry  on  the  problem 
from  this  point  exactly  as  if  we  were  starting  at  the  beginning.  That  is,  we 
solve  three  new  LP  problems  in  exactly  the  same  way  we  solved  the  last  three. 

At  the  m-th  step  of  the  problem,  the  tree  may  appear  as  in  Figure  8. 


FIGURE  8:  A  POSSIBLE  TREE  AT  THE  m-th  STEP 

The  darkened  node  is  our  best  integer  solution  so  far,  and  the  clear  pendant  nodes  have 
yet  to  be  dealt  with. 

Hopefully,  as  we  progress  further  down  the  tree,  more  and  more  nodes  will 
appear  that  do  not  need  to  be  partitioned  further.  There  are  two  main  ways  in 
which  this  can  happen:  (1)  if  an  integer  solution  is  found,  and  (2)  if  the 
node  becomes  infeasible — this  can  happen  in  one  of  three  ways: 


(a)  The  constrained  LP  problem  at  that  node  is  infeasible 

(b)  The  constrained  LP  problem  at  that  node  is  feasible,  but  the 
optimal  solution  (possibly  integer)  yields  an  optimal  functional 
value  which  is  not  less  than  the  current  best  integer  solution 
functional  value 

(c)  A  new  integer  solution  is  found  which  has  a  functional  value  which 
is  smaller  than  the  LP  functional  value  at  a  previous  node  (we 
will  then  say  that  the  previous  node  is  infeasible). 

The  algorithm  will  terminate  when  all  feasible  pendant  nodes  have  LP 
optimal  functional  values  no  less  than  the  current  best  integer  solution 
functional  value. 

A  flow  diagram  of  the  algorithm  is  given  in  Figure  9. 


FIGURE  9:  FLOW  DIAGRAM  OF  THE  ALGORITHM 
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4.  COMMENT 

At  this  time,  the  algorithm  has  not  been  programmed;  nor  is  it  anticipated 
that  it  will  in  the  near  future.  This  being  the  case,  no  statement  can  be  made  of 


its  efficiency. 
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